Papers with document importance
Attention Weights as an Indicator: Analyzing and Improving Document Utilization in Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
| Challenge: | In traditional RAG models, documents are grouped into categories based on their quality and order, and the quality of inputs is variable due to ineffective retrievers or misalignment between the retriever and generator. |
| Approach: | They propose to use attention weights to enhance document utilization from three perspectives: document ranking, placement, and filtering. |
| Outcome: | The proposed method outperforms baselines and improves document utilization effectiveness in a training-free manner. |